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The  Legislative  Audit  Committee 
of  the  Montana  State  Legislature: 

We  conducted  a  limited  scope  performance  audit  of  the  Regional  Development 
Program  at  the  Department  of  Commerce.  This  report  contains  recommendations 
relating  to  the  operation  of  this  program  and  measuring  program  outcomes. 
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Respectfully  submitted, 
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Report  Summary 


Introduction 


The  Legislative  Audit  Committee  requested  a  performance  audit  of 
the  Economic  Development  Division  within  the  Department  of 
Commerce.    We  conducted  a  preliminary  review  of  the  division  to 
determine  our  audit  scope.   Based  upon  this  review  we  determined 
it  is  difficult  to  measure  the  success  of  economic  development  in 
general.   Consequently,  in  order  to  measure  the  effectiveness  of 
economic  development,  we  focused  on  a  specific  program.   The 
Regional  Development  Program  is  the  operational  nucleus  of  the 
division  since  program  activities  can  affect  activities  for  the  other 
division  programs.    As  a  result,  we  limited  our  audit  scope  to 
reviewing  activities  of  the  Regional  Development  Program. 


Background 


The  Regional  Development  Program  provides  businesses  with 
individual  consulting  and  group  training  regarding  financial 
analysis,  financial  planning,  loan  packaging,  state  and  private 
capital  sources,  and  business  tax  incentives.   The  program  works 
with  individuals,  communities,  businesses  and  financial  institutions 
to  encourage  them  to  utilize  various  public  and  private  sector 
programs. 


The  program  is  staffed  by  five  Regional  Development  Officers 
(RDO)  whose  primary  job  is  to  be  a  liaison  between  the  Economic 
Development  Division  and  community  leaders,  local  development 
organizations,  financial  institutions,  the  business  community,  and 
federal,  state,  and  local  government  agencies. 

The  Regional  Development  Program  has  divided  the  state  into  five 
program  regions  based  on  geographic  areas  and  has  assigned  one 
RDO  to  each  area. 


Management  Controls 


Managing  is  the  process  where  people  and  resources  are  organized 
and  coordinated.    Controls  should  be  in  place  which  allow 
management  to  perform  this  process  in  the  most  efficient  manner 
possible.    During  our  review  we  identified  areas  where 
management  controls  could  be  improved. 
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Program  Mission  Should 
be  Clarified 


A  mission  can  be  defined  as  the  major  undertaking  or  function  of 
an  agency  or  program.   Every  organized  group  should  have  a 
clear,  well-defined  mission  if  its  operations  are  to  be  meaningful. 
The  current  mission  for  the  Regional  Development  Program  reads 
as  follows: 


"The  role  of  the  Regional  Development  Officer  is  to  provide 
support  and  direct  assistance  to  local  and  regional  development 
efforts.   This  is  done  by  working  with  key  businesses,  local, 
regional,  state,  and  federal  organizations  to  identify  economic 
development  needs  and  priorities  and  to  assist  with  solutions  by 
leveraging  available  resources.  The  RDO  is  principally  an 
information  resource  and  is  knowledgeable  about  a  large  variety 
of  available  programs,  technical  assistance  resources,  and 
business  finance." 

While  the  mission  describes  the  role  of  an  RDO  it  could  better 
define  the  intentions  of  the  program.   Regional  Development 
Program  staff  as  well  as  staff  from  other  division  programs  did  not 
completely  understand  the  mission  of  the  program.   Staff  wanted 
the  program  functions  and  expected  results  clarified,  and  strategies 
developed  on  how  to  achieve  expected  results.   This  would  help 
ensure  staff  time  and  efforts  are  spent  in  areas  which  are  most 
beneficial  to  both  the  program  and  its  clients. 

The  Regional  Development  Program  should  clarify  its  mission  and 
develop  formal  strategies  on  how  to  achieve  this  mission.    A 
formal  process  should  also  be  established  to  periodically  evaluate 
the  program  mission  and  strategies  in  order  to  revise  them  as 
necessary. 


Program  Guidelines 
Should  be  Developed 


Specific  guidelines  are  necessary  to  provide  staff  with  the  necessary 
direction  to  perform  job  duties  in  a  consistent  and  accurate  manner. 
During  our  review  we  found  limited  guidance  for  RDOs  in  the 
form  of  program  guidelines.   We  found  three  main  areas  where 
guidelines  should  be  established. 

-   Criteria  for  RDOs  when  selecting  clients  and  referring  clients  to 
other  programs. 
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-  Guidelines  defining  when  RDOs  should  complete  counselling 
forms. 

—  Guidelines  ensuring  RDOs  complete  quarterly  reports. 

As  a  result  of  communications  during  the  audit,  the  Regional 
Development  Program  has  established  guidelines  in  all  three  of 
these  areas. 


Handling  of  Client 
Information 


Program  staff  consider  information  they  obtain  from  clients  to  be 
confidential  in  order  to  protect  client  interests.   However,  state  law 
does  not  specifically  state  this  information  is  confidential. 
Although  some  information  may  be  considered  confidential  under 
separate  statutes,  these  statutes  may  not  apply  directly  to  the 
Regional  Development  Program  because  clients  have  voluntarily 
supplied  this  information  to  the  program.   Since  this  is  a  public 
program,  the  public  has  a  right  to  know  who  is  using  the  program. 
However,  state  law  is  unclear  as  to  what  client  information  should 
remain  confidential.   The  legislature  needs  to  define  which 
information  clients  provide  to  the  program  will  be  confidential. 


Communication  with 
Other  Economic  Develop- 
ment Organizations 


Examples  of  other  organizations  involved  in  economic  development 
include  local  development  organizations,  Small  Business 
Development  Centers,  local  government  officials,  and  Chambers  of 
Commerce.  The  Regional  Development  Program  could  improve  its 
communication  with  other  economic  development  organizations 
when  providing  assistance  to  clients  within  the  service  area  of  these 
organizations. 


No  formal  method  of  communicating  activities  existed  between  the 
Regional  Development  Program  and  these  other  development 
organizations.   To  improve  the  communications  process,  formal 
guidelines  needed  to  be  established  to  clarify  how  the 
communication  process  should  work.   As  a  result  of 
communications  during  the  audit,  the  Regional  Development 
Program  established  written  guidelines  in  this  area. 
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Monitoring  Efforts  Could 
be  Improved 


Monitoring  the  quality  and  outcomes  of  the  Regional  Development 
Program  is  important  to  ensure  the  program  is  achieving  its  desired 
results.   The  intent  of  a  monitoring  process  is  to  provide 
information  allowing  management  to  regularly  assess  a  program's 
performance  and  to  increase  a  program's  accountability  to  the 
legislature,  Governor,  and  the  public.   Program  strengths  and 
weaknesses  could  then  be  identified  and  improvements  made  where 
necessary.   Currently,  the  Regional  Development  Program  has  a 
process  which  provides  management  with  information  regarding 
program  activities.   However,  this  system  is  not  effective  in 
measuring  the  program's  performance  because  it  is  an  informal 
process  based  mainly  on  the  opinions  of  program  staff. 


Since  the  Regional  Development  Program  is  service  oriented  it  is 
important  an  effective  ongoing  monitoring  process  exist.   It  is 
important  the  program  have  a  system  in  place  which  will  show 
what  it  is  achieving.   A  national  study  of  economic  development 
programs  completed  by  the  Urban  Institute  suggests  a  monitoring 
system  include  client  surveys.   Although  client  surveys  are  not  a 
perfect  source,  they  are  one  of  the  few  ways  to  obtain  reasonably 
accurate  information  on  service  quality  and  the  results  the  service 
provided. 

The  Urban  Institute  pointed  out  that  a  successful  monitoring  system 
has  several  key  characteristics: 

—  Focus  on  service  outcomes  and  quality  of  a  program. 

—  Focus  on  helping  management  improve  program  operations. 

—  Several  performance  indicators  should  be  used  to  get  a  better 
overall  picture. 

—  Determine  the  extent  a  program's  service  caused  an  outcome. 

—  Breakout  information  by  various  client  characteristics. 

—  Information  should  be  compared  to  previous  years  to  provide  a 
"big  picture"  of  what  the  program  is  actually  achieving. 
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It  is  important  to  obtain  feedback  from  those  clients  the  program 
successfully  assisted.   However,  it  is  just  as  important  to  obtain 
feedback  from  those  clients  the  program  did  not  successfully  assist. 


The  department  is  in  the  process  of  designing  a  new  client 
database.   Department  management  indicated  the  purpose  of  this 
database  is  to  provide  more  detailed  information  regarding  clients 
and  the  type  of  service  they  received.    Creating  a  database  to 
maintain  detailed  client  information  is  one  step  in  establishing  a 
monitoring  system.    However,  the  Regional  Development  Program 
also  needs  to  develop  the  measures  to  monitor  and  assess  program 
service  and  outcomes  on  an  ongoing  basis. 


Improve  Public  Awareness 
of  the  Program 


We  conducted  a  limited  survey  of  program  clients  to  obtain  their 
opinions  regarding  program  service.   Overall,  we  found  clients 
who  have  utilized  the  program  appreciated  the  efforts  of  program 
staff.   However,  not  all  of  the  clients  we  contacted  understood  the 
role  of  the  program.   If  clients  do  not  understand  the  role  of  the 
program  then  potential  economic  development  opportunities  may  go 
undeveloped.   To  maximize  the  program's  use  it  is  important 
clients  understand  its  role. 


Since  it  is  a  public  program,  public  awareness  should  be  improved 
so  all  potential  clients  have  an  opportunity  to  use  the  program's 
services. 
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Introduction 


A  performance  audit  of  the  Economic  Development  Division  within 
the  Department  of  Commerce  was  requested  by  the  Legislative 
Audit  Committee.    Based  upon  a  preliminary  review  of  division 
activities  we  focused  our  audit  on  the  division's  Regional  Develop- 
ment Program.   The  Regional  Development  Program  provides 
technical  assistance  to  Montana  businesses  and  communities  to  help 
them  capitalize  on  potential  business  opportunities. 


Audit  Objectives 


We  reviewed  state  laws  relating  to  economic  development  and  the 
Regional  Development  Program.    Section  90-1-101,  MCA,  sets 
forth  Montana's  public  policy  pertaining  to  economic  development. 
This  law  also  recognizes  the  Department  of  Commerce  as  the 
primary  governmental  entity  for  carrying  out  economic 
development  activities.   The  Economic  Development  Division  is 
the  lead  agency  for  economic  development  within  the  Department 
of  Commerce. 


We  conducted  a  preliminary  review  of  the  Economic  Development 
Division  to  determine  our  audit  scope.   This  preliminary  review 
consisted  of  interviewing  division  management  and  staff,  reviewing 
division  records,  and  reviewing  available  management  information. 
We  determined  it  is  difficult  to  measure  the  success  of  economic 
development  in  general.    Consequently,  in  order  to  measure  the 
effectiveness  of  economic  development  it  is  important  to  focus  on  a 
specific  activity  or  program.   We  determined  the  Regional 
Development  Program  is  the  operational  nucleus  for  the  division 
since  program  activities  can  affect  activities  for  the  other  division 
programs.    As  a  result,  we  limited  our  audit  scope  to  reviewing 
activities  of  the  Regional  Development  Program.    The  limited 
scope  audit  was  conducted  in  accordance  with  governmental 
auditing  standards  for  performance  audits. 

The  objectives  of  our  audit  were  to: 

1.  Determine  the  role  of  the  division's  Regional  Development 
Program. 

2.  Evaluate  the  management  controls  over  the  division's  Regional 
Development  Program. 
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3.      Make  appropriate  recommendations  to  make  the  Regional 
Development  Program  more  effective. 


Audit  Scope  and 
Methodology 


We  gathered  and  reviewed  a  variety  of  information  describing  the 
reasons  the  Regional  Development  Program  was  created.   This 
included  the  Montana  Futures  Project  which  was  completed  in  1993 
by  the  Governor's  Council  for  Montana's  Future.   We  also 
interviewed  department  management  to  determine  why  the  program 
was  created. 


We  evaluated  the  program's  role  in  the  division's  economic 
development  activities.   This  included  determining  services  the 
program  provides,  interviewing  program  staff,  and  interviewing 
staff  from  other  division  programs.    We  also  contacted  businesses, 
community  leaders,  and  local  development  organizations  who  have 
used  the  program  to  determine  if  they  understood  the  program's 
role,  and  obtained  their  opinions  on  how  the  program  could  be 
improved. 

We  interviewed  Regional  Development  Officers  (RDOs)  and 
reviewed  their  position  descriptions  to  determine  their  responsi- 
bilities.  We  travelled  with  RDOs  to  observe  their  interaction  with 
program  customers.   Client  files  and  available  management  infor- 
mation documenting  program  activities  were  also  reviewed. 

We  evaluated  the  management  controls  by  reviewing  program 
guidelines,  operating  strategies,  priorities,  and  staff  training.   We 
also  examined  the  program's  coordination  and  communication  with 
economic  development  organizations  outside  the  division. 

We  evaluated  the  process  for  monitoring  program  performance. 
This  included  assessing  the  program's  procedures  for  determining 
program  service  and  outcomes.   We  interviewed  division  staff  and 
management  to  determine  how  they  monitor  the  overall  perfor- 
mance of  the  program.    We  also  gathered  information  describing 
methods  for  monitoring  various  types  of  economic  development 
programs. 

During  the  audit,  we  contacted  other  states  with  programs  similar 
to  the  Regional  Development  Program.    We  gathered  various 
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information  from  these  states  regarding  how  their  programs  operate 
and  compared  them  against  Montana's  program. 


Data  Limitations 


Government  auditing  standards  require  disclosure  of  any  constraints 
imposed  on  the  audit  due  to  the  data  limitations.    At  the  time  of 
our  review  the  Regional  Development  Program  was  new.    There- 
fore, a  limited  amount  of  management  information  was  maintained 
and  generated  for  the  program.   These  data  limitations  impacted 
our  ability  to  determine  the  overall  effectiveness  of  program 
operations.   For  example,  information  relating  to  program  activities 
and  clients  were  not  being  reported  by  some  program  staff. 


The  division  is  in  the  process  of  implementing  a  new  computerized 
client  database.   This  database  should  improve  the  management 
information  maintained  and  generated  for  the  Regional  Develop- 
ment Program.    The  effect  of  data  limitations  is  discussed  in 
Chapter  III. 


Compliance 


As  part  of  our  audit  we  reviewed  compliance  with  state  laws 
related  to  the  Regional  Development  Program.    Few  laws  exist 
relating  to  the  program  and  those  which  do  exist  are  not  specific 
making  compliance  testing  difficult.    However,  the  department  is  in 
compliance  with  those  laws  we  could  test. 


One  Issue  Discussed 
with  Department 

Officials 


In  addition  to  the  issues  addressed  in  Chapter  III,  we  discussed  one 
additional  issue  with  department  officials.   The  following  briefly 
describes  the  issue: 


System  Guidelines  for  New  Client  Database  -  The  Economic 
Development  Division  is  in  the  process  of  implementing  a  client 
database  to  help  improve  coordination  between  programs  within  the 
division  and  to  improve  the  program's  management  information. 
To  ensure  effective  use  of  this  system  and  to  maintain  the  integrity 
of  database  information,  we  suggested  the  division  develop  guide- 
lines for  this  system. 
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Introduction 


Section  90-1-101,  MCA,  defines  economic  development  as 
promoting,  stimulating,  and  encouraging  the  planning  and  develop- 
ment of  the  economy  of  the  state.    Section  90-1-105,  MCA, 
specifies  economic  development  functions  of  the  Department  of 
Commerce.    These  include  providing  coordinating  services  to  aid 
state  and  local  economic  development  groups,  aiding  communities 
in  obtaining  or  expanding  new  business  and  markets,  and 
distributing  information  regarding  the  advantages  of  developing 
various  economic  enterprises  within  the  state.   To  meet  the  intent 
of  this  law,  the  Department  of  Commerce  centralized  many  of 
these  functions  within  the  Economic  Development  Division. 


Economic  Development 
Division  Programs 


The  Economic  Development  Division  provides  various  types  of 
technical  assistance  directly  to  businesses  and  communities.   This 
assistance  is  designed  to  help  businesses  and  communities  capitalize 
on  potential  economic  development  opportunities.    The  division 
provides  this  assistance  with  seven  different  programs: 

Regional  Development  Program  -  This  program  provides 
businesses  with  individual  consulting  and  group  training  regarding 
financial  analysis,  financial  planning,  loan  packaging,  state  and 
private  capital  sources,  and  business  tax  incentives.   The  program 
also  works  with  communities,  businesses,  and  financial  institutions 
to  encourage  them  to  utilize  various  public  and  private  sector 
programs.   These  programs  may  include  Community  Development 
Block  Grants,  Economic  Development  Administration  loans  and 
grants,  Small  Business  Administration  loan  guarantees,  the 
Microbusiness  Finance  Program,  private  lenders,  and  local 
revolving  funds.   This  program  also  oversees  the  Certified 
Communities  Program  which  helps  guide  cities,  towns,  counties, 
and  tribal  governments  in  preparing  community  assessment  and 
action  plans. 

Business  Recruitment  -  This  program  publicizes  and  represents 
Montana  to  firms  considering  relocations  or  expansions  into 
Montana.   The  business  recruitment  program  also  prepares  location 
data  in  response  to  inquiries  about  topics  such  as  taxation,  labor 
supply  and  wages,  vendor  support,  available  sites  and  facilities, 
and  state  and  local  assistance  programs. 

Community  Development  Block  Grant  -  Economic  Development  - 
The  Economic  Development  Division  administers  the  Community 
Development  Block  Grant  Economic  Development  (CDBG-ED) 
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Program  funding  for  local  development  projects.   Each  year,  this 
federally  funded  competitive  grant  program  awards  over 
$2.5  million  to  Montana  cities,  towns,  and  counties  for  lending  to 
private  business  projects.   This  program  also  administers  a 
federally  funded  revolving  loan  fund  consisting  of  Economic 
Development  Administration  (EDA)  funds. 

Microbusiness  Finance  -  Montana  "micro"  business  companies  with 
ten  or  fewer  employees  and  annual  gross  revenues  under  $500,000 
can  receive  loans  of  up  to  $20,000  from  12  non-profit  regional 
Microbusiness  Development  Corporations  (MBDC)  which  have 
been  certified  by  the  Department  of  Commerce.    This  loan 
program  is  designed  to  fund  economically  sound  business  projects 
which,  because  of  their  small  size,  are  unable  to  obtain  regular 
commercial  financing.   Businesses  generally  use  borrowed  funds 
for  working  capital  or  start-up  purposes. 

Trade  Program  -  This  program  works  to  increase  Montana's 
domestic  and  international  export  sales  and  its  volume  of 
international  visitors,  tourism,  and  investment.   The  program 
serves  mainly  small  and  medium-sized  firms  new  to  the 
international  market  with  cross-cultural  and  technical  guidance. 
The  program  helps  Montana  companies  capitalize  on  foreign  trade 
opportunities.   Trade  offices  are  located  in  Kumamoto,  Japan  and 
Taipei,  Taiwan.  Offices  in  Calgary  and  Tokyo  were  recently 
closed  due  to  department  budget  reductions. 

Census  and  Economic  Information  Center  -  The  Census  and 
Economic  Information  Center  (CEIC)  is  the  state  designated 
affiliate  which  receives  information  from  the  U.S.  Bureau  of  the 
Census.   It  maintains  a  library  which  distributes  demographic, 
economic  and  business  information  to  government  entities,  the 
business  community,  educational  institutions  and  the  public.   Types 
of  information  maintained  include  characteristics  of  the  state 
including  its  people,  economy,  and  land. 

Small  Business  Development  Center  -  The  Montana  Department  of 
Commerce  and  the  U.S.  Small  Business  Development  Admin- 
istration jointly  fund  the  Montana  Small  Business  Development 
Center  (SBDC).   The  Montana  SBDC's  primary  goal  is  to  increase 
business  profits  and  employment  in  Montana  by  assisting  in  small 
business  start-up  and  expansion.   The  SBDC  provides  businesses 
with  training,  technical  assistance,  and  information  through  its 
statewide  network  of  eight  SBDC  service  centers.   The  service 
centers  are  located  in  Billings,  Havre,  Kalispell,  Bozeman, 
Missoula,  Butte,  and  Sidney.  The  centralized  program  center  is 
located  in  Helena. 
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Economic  Development 
Division  Organization 


Our  review  concentrated  specifically  on  the  division's  Regional 
Development  Program.    The  program  shares  administrative  support 
with  the  division's  Business  Recruitment,  Community  Development 
Block  Grant,  and  Microbusiness  Programs.    The  following  figure 
illustrates  the  reporting  structure  for  the  entire  division  and  where 
we  focused  our  review. 


Figure  1 


Economic  Development  Division  Reporting  Structure 
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ECONOMIC  DEVELOPMENT  DIVISION 


Source:  Compiled  by  the  Office  of  the  Legislative  Auditor 
from  Division  records 


Regional  Development 
Program 


The  following  sections  provide  a  description  of  the  Regional 
Development  Program.    This  includes  program  staffing,  funding, 
why  the  program  was  established,  and  how  the  program  provides 
its  services. 


Program  Funding  and 
Expenditures,  History, 
and  Services 


The  Regional  Development  Program  is  staffed  by  five  RDOs  who 
work  under  the  direction  of  the  Department  of  Commerce's 
Director  and  Deputy  Director.   This  program  receives  its  funding 
from  the  state  General  Fund.   The  following  table  illustrates  the 
appropriation  and  expenditure  levels  for  the  regional  development 
program  for  fiscal  years  1993-94  through  1994-95. 
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Table  1 
Regional  Development  Program  Appropriation 

and  Expend 

tures 

Category 

Personal  Services 
Operating  Expenses 
Equipment 
Total 

Source:   Compi led  by 
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Actual 

Expenditures 

FY  1993-94 

$237,771 

123,818 

16.000 

$377,589 

Office  of  the  Leg  is 

Appropr 

FY  199 

$261 

129 

i at  ions 
4-95 

560 

988 
0 

548 

"tor  from 

$391 
lative  Aud 

Why  was  the  Regional 
Development  Program 
Established? 


In  1992  the  Governor's  Council  for  Montana's  Future  was  charged 
with  evaluating  the  state's  economic  future.   The  Council  was 
comprised  of  statewide  business  and  economic  development 
leaders.   This  evaluation,  called  The  Montana  Futures  Project, 
assessed  several  aspects  of  Montana's  economic  development 
process,  including  the  organization  of  the  Economic  Development 
Division.   During  its  evaluation,  the  council  considered  a  variety  of 
information  from: 

—  Previous  statewide  studies  and  initiatives. 
Twenty-nine  town  meetings  held  around  the  state. 
A  statewide  review  of  economic  and  demographic 
information. 

—  A  comparison  of  other  states  economic  development 
initiatives. 

—  A  statewide  telephone  survey. 

The  Montana  Futures  Project  resulted  in  several  recommendations 
to  improve  various  aspects  of  Montana's  economic  development 
system.    This  included  recommendations  to  improve  service 
delivery  mechanisms  for  the  Economic  Development  Division. 
The  project  report  recommended  the  division  use  a  regional 
development  concept  to  improve  the  delivery  of  its  services. 

In  addition  to  this  project,  Department  of  Commerce  officials  said 
they  conducted  their  own  assessment  of  division  services.   Depart- 
ment management  indicated  this  evaluation  consisted  of  visiting 
over  50  Montana  communities  and  obtaining  information  regarding 
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the  type  of  service  communities  and  business  people  believed  they 
required.   Department  officials  said  they  also  met  with  other  state 
and  federal  agencies,  local  development  organizations,  and  state 
university  units  to  gather  additional  information.   This  evaluation 
resulted  in  findings  similar  to  those  of  the  Montana  Futures 
Project.   The  study  determined  the  division  needed  to  take  a  more 
proactive  approach  in  its  economic  development  efforts. 
Businesses  and  communities  wanted  the  division  to  take  a  more 
active  role  in  seeking  out  economic  development  opportunities  and 
in  providing  assistance  to  develop  these  opportunities.    Department 
officials  indicated  a  regional  development  concept  was  "almost 
universally  recommended  and  endorsed  by  all  the  various  groups 
and  individuals  who  participated  in  this  evaluation." 


Based  upon  these  two  studies  department  officials  determined  the 
division  needed  a  program  which  provided  enough  flexibility  to 
encompass  the  varying  client  needs.   As  a  result  the  Regional 
Development  Program  was  established. 


How  are  Services  for  the 
Regional  Development 
Program  Provided? 


The  Regional  Development  Program  defines  its  client-base  as 
Montana  businesses,  communities  and  counties.   Community 
clients  include  town  councils,  city  commissions,  community 
leaders,  Chambers  of  Commerce,  and  local  development  organi- 
zations.  County  clients  generally  refers  to  county  commissions. 


Identification  of  Program 
Clients 


Program  clients  and  potential  projects  can  be  identified  in  a  number 
of  ways.    Clients  who  are  familiar  with  the  program  may  contact 
the  program  directly  and  request  assistance.   However,  since  the 
program  was  established  to  be  more  proactive,  program  staff  also 
actively  seek  out  clients  and  projects.   This  can  be  done  in  a 
variety  of  ways  such  as  meeting  with  local  development  organiza- 
tions, local  government  officials,  community  leaders,  or  attending 
business  seminars.    During  our  review  we  found  the  program 
should  establish  formal  guidelines  related  to  selecting  clients  and 
projects.   This  issue  is  discussed  in  further  detail  in  Chapter  III  of 
our  report. 
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Providing  Resources 


The  program  is  responsible  for  providing  its  clients  with  resources 
to  take  advantage  of  economic  development  projects.    Resources 
can  be  provided  either  through  personal  consultation  by  program 
staff  or  by  referring  clients  to  other  areas  such  as  state  and  federal 
agencies  or  programs,  universities  and  colleges,  or  to  the  private 
sector.   Private  sector  resources  can  include  financial  institutions, 
venture  capital  companies,  or  consultants.   One  of  the  most 
important  aspects  of  the  program  is  ensuring  an  effective  flow  of 
information  between  the  program,  its  clients,  and  available 
resources  by  providing  a  central  point  of  contact. 


Information  flows  to  and  from  program  clients  and  program 
resources  through  the  RDOs.  This  enables  them  to  research  and 
identify  resources  which  can  provide  clients  with  the  assistance 
they  need.   The  following  figure  portrays  how  information  flows 
between  the  Regional  Development  Program,  its  clients,  and  the 
various  resources  available. 


Figure  2 

How  Information  Flows  Between  the  Regional  Development 
Program.  Program  Clients,  and  Program  Resources 
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Page  10 


Chapter  II  -  Background 


The  five  RDOs  primary  job  is  to  be  a  liaison  between  the 
Economic  Development  Division  and  community  leaders,  local 
development  organizations,  financial  institutions,  the  business 
community,  and  federal,  state,  and  local  government  agencies. 
RDO  job  duties  include  providing  technical  assistance  to  clients  in 
the  areas  of  financial  analysis,  business  planning,  loan  packaging, 
and  marketing.   Other  duties  include  advising  clients  regarding 
government  finance  programs,  conducting  informational  seminars, 
and  assisting  with  community  development  projects. 

Since  the  program  may  be  involved  in  a  variety  of  projects,  RDOs 
must  have  skills  in  a  variety  of  disciplines.   Those  areas  where 
RDOs  have  experience  include  business  financial  planning  and 
analysis,  loan  packaging,  marketing,  trade,  and  community 
development. 


Regional  Development 
Program  uses  Regional 
Approach 


The  state  is  divided  into  five  program  regions  based  on  geographic 
area.   Each  RDO  is  responsible  for  identifying  and  pursuing 
economic  development  opportunities  within  their  assigned  region. 
The  RDOs  centralize  their  operations  from  Helena  and  generally 
spend  a  minimum  of  four  days  per  week  on  the  road  within  their 
assigned  regions. 


When  the  program  was  established  the  division  analyzed  the 
benefits  and  drawbacks  of  placing  RDOs  in  Helena  or  within  their 
assigned  regions.   They  determined  placing  the  RDOs  in  Helena 
would  provide  the  best  service  to  its  clients.   The  main  reason  for 
this  is  because  local  communities,  counties,  and  businesses  are  very 
competitive  with  each  other.   The  division  concluded  that  placing 
RDOs  within  a  specific  community  would  give  the  appearance  of 
"favoritism"  to  that  community.   The  division  believes  it  is 
important  to  ensure  the  program  remains  neutral  and  centralizing 
the  RDOs  within  Helena  provides  this  neutrality.   Other  reasons 
RDOs  are  centralized  in  Helena  include  immediate  access  to  other 
state  and  federal  programs  and  the  ability  to  coordinate  activities 
with  other  division  programs. 

The  following  diagram  identifies  the  five  Regional  Development 
Program  regions. 
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Figure  3 

Regional  Breakout  for  Regional  Development  Program 


Source: 


Compiled  by  the  Office  of  the  Legislative  Audi 
program  records. 


tor  from 


Program  Activities 
Concentrated  in  Two 
Areas 


Department  officials  consider  the  Regional  Development  Program 
to  be  at  the  center  of  the  division's  economic  development  process. 
It  is  generally  the  first  step  in  identifying  economic  development 
opportunities  in  the  state.   Program  activities  are  concentrated  in 
two  main  areas.   These  areas  are  discussed  below. 


Local  and  Regional 
Development 


Local  and  regional  development  is  the  process  of  helping 
communities  and  counties  achieve  their  economic  and  community 
development  goals.   It  is  also  designed  to  help  improve  the  capacity 
of  economic  development  efforts  at  the  local  level. 

Each  community,  county,  and  region  will  have  different  individuals 
and  organizations  which  assume  the  lead  role  in  economic 
development  activities.   These  include  mayors,  city  council 
members,  county  commissioners,  bank  officers,  chambers  of 
commerce,  local  development  organizations,  and  individual 
citizens.   The  program  works  with  these  individuals  and 
organizations  to  help  them  take  advantage  of  economic 
development  opportunities  within  their  areas. 
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The  program  is  also  directly  involved  in  the  development  of  appli- 
cations (technical  assistance,  financial  analysis,  due  diligence)  for 
Community  Development  Block  Grant  funds  for  economic 
development.    Program  staff  are  responsible  for  providing  ongoing 
technical  assistance  to  the  applicant  for  these  funds. 


Business  Assistance  and 
Development 


The  second  area  where  the  program  concentrates  its  efforts  is 
business  assistance  and  development.    Assistance  provided  to 
businesses  may  include  business  planning,  financial  analysis, 
marketing,  identifying  potential  loan  sources,  or  loan  packaging. 
The  program  also  refers  businesses  to  other  appropriate  resources 
which  could  more  appropriately  serve  their  needs  (Small  Business 
Development  Centers,  entrepreneur  centers,  local  development 
organizations,  etc). 


What  Kinds  of  Projects 
has  the  Program  been 
Involved  In? 


As  discussed  in  Chapter  I,  the  program  maintains  a  limited  amount 
of  information  regarding  program  activities  and  clients.   However, 
the  program  does  maintain  information  regarding  the  kinds  of 
projects  in  which  it  was  involved.   Examples  of  these  projects 
include: 


Assisted  with  the  development  of  three  business  expansion 
projects  which  resulted  in  a  total  of  $1.2  million  in  new 
investment  from  banks,  equity,  and  other  funds. 

Worked  extensively  with  a  high-tech  company  providing 
financial  analysis  and  other  technical  assistance  due  to  on- 
going financial  problems  with  the  company.    This  provided 
company  management  with  increased  awareness  regarding 
financial  problems  and  resulted  in  a  new  business  plan  and 
strategy  to  change  operations. 

Provided  technical  assistance  to  a  city  and  county  in  complet- 
ing Community  Development  Block  Grant  applications. 

Provided  technical  assistance  to  a  dental  firm  in  mass 
merchandising  its  products  resulting  in  orders  from  a  major 
discount  department  store. 

Provided  technical  assistance  to  a  community  helping  to 
identify  possible  grant  programs  to  finance  tourism  expansion. 

Provided  technical  and  financial  assistance  to  a  hospital  result- 
ing in  a  loan  package  totaling  $2  million. 
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We  Conducted  a  Limited 
Survey  of  Clients 


We  conducted  a  limited  survey  of  program  clients  to  obtain  their 
opinions  regarding  the  quality  of  program  service.   Data  limita- 
tions restricted  our  survey  because  although  we  were  able  to 
identify  clients  which  received  assistance,  we  were  not  able  to 
readily  identify  clients  the  program  could  not  assist. 
Consequently,  we  could  not  obtain  the  viewpoints  of  these 
clients. 


We  generally  found  clients  we  contacted  were  satisfied  with  the 
service  they  received.   They  believe  the  program  simplifies  the 
accessibility  to  government  and  makes  it  easier  to  get  the  assis- 
tance they  desire.   However,  the  clients  also  believe  improve- 
ments could  be  made  to  the  program.   Examples  of  areas  clients 
would  like  to  see  improvements  made  include  clarifying  the  role 
of  the  program,  improving  communications  between  the  program 
and  other  economic  development  organizations,  and  improving 
public  awareness  of  the  program.   These  issues  are  discussed  in 
Chapter  III  of  the  report. 


Page  14 


Chapter  III  -  Regional 
Development  Program  Management  Controls 


Introduction 


Managing  is  the  process  where  people  and  resources  are  organized 
and  coordinated.   Controls  should  be  in  place  which  allow  manage- 
ment to  perform  this  process  in  the  most  efficient  manner  possible. 
During  our  review  of  the  Regional  Development  Program  we 
identified  areas  where  management  controls  could  be  improved. 
The  following  sections  discuss  areas  where  we  believe 
improvements  could  be  made. 


Program  Mission  should 
be  Clarified 


A  mission  can  be  defined  as  the  major  undertaking  or  function  of 
an  agency  or  program.   Every  organized  group  operation  should 
have  a  clear,  well-defined  mission  if  its  operations  are  to  be  mean- 
ingful.  The  current  mission  for  the  Regional  Development  Pro- 
gram relates  specifically  to  the  RDO.   It  reads  as  follows: 

"The  role  of  the  Regional  Development  Officer  is  to  provide 
support  and  direct  assistance  to  local  and  regional  develop- 
ment efforts.   This  is  done  by  working  with  key  businesses, 
local,  regional,  state,  and  federal  organizations  to  identify 
economic  development  needs  and  priorities  and  to  assist  with 
solutions  by  leveraging  available  resources.   The  RDO  is 
principally  an  information  resource  and  is  knowledgeable 
about  a  large  variety  of  available  programs,  technical  assis- 
tance resources,  and  business  finance." 

While  the  mission  describes  the  role  of  an  RDO  it  could  better 
define  the  intentions  of  the  program. 

We  found  staff  do  not  completely  understand  the  mission  of  the 
program.   This  included  staff  for  both  the  Regional  Development 
Program,  as  well  as  staff  from  other  division  programs.    Staff 
would  like  the  program  functions  clarified,  what  results  are 
expected,  and  strategies  developed  on  how  to  achieve  expected 
results.   This  would  help  ensure  staff  time  and  efforts  are  spent  in 
areas  which  are  most  beneficial  to  both  the  program  and  its  clients. 

We  contacted  the  Department  of  Commerce  for  seven  other  states 
and  found  most  have  programs  similar  to  the  Regional  Develop- 
ment Program.   These  states  have  established  clear  directives  or 
strategies  as  to  what  they  want  the  program  to  accomplish.   For 
example,  Idaho  develops  an  action  plan  each  year  by  re-evaluating 
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the  program  mission  and  determining  where  changes  are  needed  to 
improve  the  program.    For  areas  such  as  business  and  community 
development  specific  strategies  are  developed  on  how  the  mission 
will  be  achieved. 

Department  management  agree  the  program's  mission  should  be 
better  defined.   This  includes  establishing  strategies  for 
accomplishing  its  mission.   A  formal  process  should  also  be 
established  to  periodically  evaluate  the  program  mission  and 
strategies  to  determine  if  they  need  to  be  revised.   This  process 
could  be  tied  to  improving  the  monitoring  process  which  is 
discussed  later  in  the  report. 


Recommendation  #1 

We  recommend  the  Regional  Development  Program: 

A.  Clarify  its  mission, 

B.  Develop  formal  strategies  on  how  to  achieve  this 
mission,  and 

C.  Develop  a  formal  process  for  periodically  re-evalu- 
ating its  mission  and  strategies. 


Program  Guidelines  Specific  program  guidelines  are  necessary  to  provide  staff  with  the 

should  be  Established  necessary  direction  to  perform  job  duties  in  a  consistent  and 

accurate  manner.   Formal  guidelines  can  also  strengthen 
management's  control  over  program  operations  and  help  to  assure 
continuity  of  services  as  staffing  changes  occur.   We  found  limited 
guidance  is  available  to  staff  in  the  form  of  program  guidelines. 
This  has  caused  inconsistencies  in  how  some  portions  of  the 
program  operate.   Program  staff  indicated  decisions  regarding 
program  operations  are  often  made  on  a  case-by-case  basis  through 
consultation  between  staff  and  management.    However,  they  told  us 
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they  would  like  formal  guidelines  established  to  improve  guidance 
and  consistency  in  how  they  perform  their  jobs. 

While  conducting  our  audit  we  identified  areas  where  formalized 
guidelines  should  be  established.  The  following  sections  discuss 
some  of  these  areas. 


How  are  Clients  and 
Projects  Selected  and 
Referred? 


Presently  it  is  not  clear  what  criteria  program  staff  should 
consider  when  choosing  clients  or  economic  development 
projects.   We  identified  some  program  inconsistencies  because 
RDOs  were  not  using  similar  criteria  when  making  this 
determination.   For  example,  some  RDOs  indicated  they  will 
work  with  anyone  who  contacts  them  or  pursue  any  project  they 
may  identify.   Other  RDOs  stated  they  consider  various  factors 
for  selecting  clients  and  projects  such  as  the  type  of  business  or 
project,  the  potential  for  creating  jobs,  or  the  size  of  the  busi- 
ness or  project.   In  these  cases,  RDOs  indicated  larger  projects  or 
businesses  were  generally  provided  direct  assistance  with  smaller 
ones  being  referred  elsewhere.  Guidelines  should  be  established 
which  clarify  the  criteria  to  be  considered  when  choosing  pro- 
gram clients  and  economic  development  projects  or  referring 
them  elsewhere. 


When  Should  Counselling 
Forms  be  Completed? 


The  program  uses  counselling  forms  to  document  and  summarize 
the  assistance  provided  to  clients.   However,  counselling  forms 
are  not  always  completed  by  program  staff  when  assistance  was 
provided  to  business  clients.   In  addition,  we  could  not  identify 
any  instances  where  these  forms  were  completed  when  assistance 
was  provided  to  communities.   By  not  completing  these  forms, 
the  division  does  not  have  an  accurate  record  of  who  they  are 
helping,  the  number  of  clients,  or  the  type  of  assistance  they  are 
providing. 


Program  staff  indicated  counseling  forms  should  be  completed 
when  assistance  is  of  a  significant  nature.   However,  there  is 
nothing  in  place  outlining  when  these  forms  should  be  completed 
or  defining  assistance  of  a  significant  nature.   Guidelines  would 
help  clarify  this  issue. 
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Quarterly  Reports  are  not 
Always  Complete 


RDOs  complete  quarterly  reports  describing  assistance  they 
provide  during  the  quarter.   These  reports  are  provided  to 
management  to  keep  it  informed  of  the  status  of  projects  in 
which  they  are  involved.   During  our  audit,  we  found  RDOs  did 
not  always  complete  quarterly  reports.   As  part  of  its  record 
keeping  requirements  the  program  should  develop  guidelines 
ensuring  these  reports  be  completed  within  a  specified  time 
frame. 


Conclusion; 

As  a  result  of  our  communications  during  the  audit,  the 
Regional  Development  Program  has  developed  guidelines 
providing  RDOs  with  direction  in: 

A.  Selecting  and  referring  clients  or  projects. 

B.  Completing  counseling  forms. 

C.  Completing  quarterly  reports. 


Handling  of  Client 
Information 


Program  staff  consider  information  they  obtain  from  clients  to  be 
confidential  in  order  to  protect  client  interests.   However,  state  law 
does  not  specifically  state  this  information  is  confidential. 
Although  some  information  may  be  considered  confidential  under 
separate  statutes,  these  statutes  may  not  apply  directly  to  the 
Regional  Development  Program  because  the  clients  have 
voluntarily  supplied  this  information  to  the  program. 

Throughout  our  audit,  Regional  Development  Program  staff  told  us 
information  obtained  from  their  clients  was  confidential.   Staff  also 
said  clients  are  informed  that  information  provided  to  the  program 
is  confidential.   Examples  of  information  considered  to  be  confi- 
dential include  personal  financial  statements,  business  financial 
statements,  business  plans,  and  business  and  personal  tax  returns. 
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Section  2-6-104,  MCA,  provides  for  the  public  inspection  of  public 
records.    Section  2-6-202,  MCA,  defines  public  records  as  any 
paper,  correspondence,  form,  book,  photograph,  microfilm, 
magnetic  tape,  computer  storage  media,  map,  drawing,  or  other 
document  which  has  been  made  or  received  by  a  state  agency  in 
connection  with  the  transaction  of  official  business.   This  includes 
information  maintained  by  staff  of  the  Regional  Development 
Program. 


The  department's  legal  counsel  indicated  that  the  1972  Montana 
Constitution  recognizes  both  the  right  to  privacy  and  the  public's 
right  to  know.   Their  legal  counsel  also  cited  two  examples  of  case 
law  where  the  Montana  Supreme  Court  ruled  in  favor  of  the  right 
to  privacy  for  businesses  and  individuals  over  the  public's  right  to 
know.    Consequently,  department  officials  believe  they  are 
required  to  evaluate  each  request  for  information  against  the 
foregoing  case  law.   They  also  believe  public  disclosure  of  trade 
secret  business  plans  and  other  business  information  would 
negatively  affect  the  program's  ability  to  assist  businesses  and 
individuals. 

Although  there  is  case  law  relating  to  the  public's  right  to  know 
and  the  right  to  privacy,  state  law  does  to  specifically  address  the 
Regional  Development  Program.   Since  this  is  a  public  program, 
the  public  has  a  right  to  know  who  is  using  the  program. 
However,  state  law  is  unclear  as  to  what  client  information  should 
remain  confidential.   The  Legislature  needs  to  define  which 
information  it  believes  should  remain  confidential. 


Recommendation  #2 

We  recommend  the  Legislature  define  which  information 
clients  provide  to  the  Regional  Development  Program  will 
be  confidential. 
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Program  Communica- 
tion could  be  Improved 


During  our  evaluation  we  found  communication  between  the 
Regional  Development  Program  and  outside  economic  development 
agencies  could  be  improved.    The  following  section  discusses  this 
issue. 


Communication  with  other 
Economic  Development 
Organizations 


Other  organizations  involved  in  economic  development  include 
local  development  organizations,  Small  Business  Development 
Centers,  local  government  officials,  county  government  officials, 
or  Chambers  of  Commerce.    Often  times  other  economic  develop- 
ment organizations  request  an  RDO  to  provide  assistance  to  a  client 
because  the  other  organization  may  not  have  the  expertise  or 
resources  to  provide  a  certain  level  of  assistance.   For  example,  a 
local  development  organization  may  refer  a  client  to  an  RDO  to 
provide  assistance  related  to  a  specific  kind  of  financial  analysis 
they  do  not  have  the  expertise  to  provide.   Also,  a  client  may 
simply  prefer  to  work  with  RDOs  instead  of  the  local  development 
organization.   Reasons  for  this  may  be  to  protect  trade  secrets  for  a 
project  or  because  the  client  has  an  established  working  relationship 
with  the  program.   In  these  cases  clients  will  normally  contact  an 
RDO  directly  for  assistance.   During  our  audit  we  determined  the 
Regional  Development  Program  could  improve  its  communication 
with  other  economic  development  organizations  when  providing 
assistance  to  clients  within  the  service  area  of  these  organizations. 


We  discussed  this  issue  with  economic  development  organizations 
around  the  state  including  local  development  organizations, 
Chambers  of  Commerce,  Small  Business  Development  Centers, 
and  city  and  county  government  officials.   While  the  organizations 
we  interviewed  appreciate  the  efforts  of  the  program,  they  would 
like  the  program  to  improve  its  process  for  communicating  its 
activities  with  them.   This  is  to  ensure  they  are  kept  informed  of 
any  assistance  the  program  provides  to  a  client  who  is  located 
within  their  area.   These  organizations  believe  the  program  needs  a 
more  systematic  method  for  communicating  projects  it  is  pursuing. 

These  organizations  also  indicated  it  is  important  communication 
take  place  to  avoid  duplicating  the  services  they  provide.   We 
identified  some  instances  where  duplication  of  services  occurred 
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because  communication  had  not  taken  place.   For  example,  we 
identified  a  situation  where  a  Small  Business  Development  Center 
(SBDC)  was  providing  assistance  to  a  business  client  when  an  RDO 
began  to  provide  similar  assistance.    SBDC  staff  indicated  they  did 
not  ask  for  the  RDOs  help  in  providing  assistance  to  the  client  and 
they  only  managed  to  confuse  the  client. 

Department  management  stated  one  of  the  primary  RDO  goals  is  to 
"identify  and  introduce  themselves  to  the  key  players  (i.e.  local 
development  organizations,  SBDCs,  local  government  officials,  etc) 
involved  in  economic  and  community  development  within  their 
regions."   We  believe  RDOs  have  done  this  and  understand  who 
the  key  economic  development  players  are  within  their  regions. 
However,  we  found  no  formal  method  of  communicating  activities 
exists  between  the  Regional  Development  Program  and  the  other 
organizations  even  though  program  staff  told  us  they  try  to  notify 
the  appropriate  organization.   To  improve  the  communication 
process,  formal  guidelines  may  need  to  be  established  to  clarify 
how  the  communication  process  should  work. 


Conclusion: 

As  a  result  of  our  communications  during  the  audit,  the 
Regional  Development  Program  has  established  written 
guidelines  on  when  to  communicate  its  activities  with  other 
economic  development  organizations. 


Monitoring  Efforts  Monitoring  the  quality  and  outcomes  of  the  Regional  Development 

could  be  Improved  Program  is  important  to  ensure  the  program  is  achieving  its  desired 

results.   The  intent  of  a  monitoring  process  is  to  provide  informa- 
tion allowing  management  to  regularly  assess  the  performance  of 
the  program  and  to  increase  a  programs  accountability  to  the 
legislature,  governor,  and  the  public.   Program  strengths  and 
weaknesses  could  then  be  identified  and  improvements  made  where 
necessary.    A  system  currently  exists  which  provides  department 
management  with  information  regarding  program  activities. 
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However,  this  system  provides  only  limited  data  to  measure 
program  performance.    The  program  could  improve  its  process  for 
monitoring  program  service  and  outcomes. 


How  are  Program  Services  The  current  monitoring  system  consists  of  program  staff  reporting 

Currently  Monitored?  to  department  management  projects  and  activities  they  are  pursuing 

and  their  status  at  the  time  the  report  is  completed.   This  system 
involves  the  completion  of  quarterly  performance  reports  which 
describe  and  categorize  the  major  activities  and  projects.   These 
reports  classify  activities  in  a  number  of  different  areas.   Examples 
of  these  areas  include: 

Advocacy  -  This  represents  program  efforts  to  represent  business 
interests  within  a  region.   Such  efforts  attempt  to  improve  the 
business  environment.   Advocacy  efforts  may  include  public 
speeches,  testimony  before  state  or  federal  legislatures,  or  explain- 
ing various  government  programs  available  to  help  businesses. 

Capital  Formation  -  This  represents  program  efforts  to  develop  or 
assist  businesses  and  communities  in  developing  capital  (loans, 
grants,  etc).   This  activity  may  include  developing  Community 
Development  Block  Grants,  venture  capital  resources,  and  federal, 
state,  or  local  finance  programs. 

Economic  Development  -  This  represents  general  activities  that  are 
designed  for  supporting  and  strengthening  the  economic  environ- 
ment within  the  region.   Examples  of  activities  may  include 
community  development  projects  or  assisting  local  development 
organizations  with  projects. 

Success  Stories  -  These  are  examples  of  where  program  staff 
believe  the  assistance  they  provided  produced  positive,  tangible 
results.   Information  includes  a  description  of  the  business,  the 
assistance  provided,  the  resources  utilized,  and  actual  or  potential 
results. 

While  this  reporting  system  provides  management  with  data  about 
activities  the  program  is  pursuing,  it  does  not  provide  an  ongoing 
means  of  measuring  program  quality  or  outcomes.   For  example, 
although  the  reports  provide  information  regarding  "success 
stories,"  these  are  generally  from  the  perspective  of  program  staff. 
They  include  results  that  staff  believe  will  happened  and  not 
necessarily  what  did  happen.   Success  stories  do  not  necessarily 
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consider  the  opinions  of  the  client  regarding  the  quality  of  service 
or  what  actually  resulted  from  the  assistance  received.   The  current 
system  also  does  not  obtain  input  from  those  who  the  program 
could  not  assist  so  their  opinions  are  not  being  considered. 

Information  regarding  program  performance  is  also  gathered  from 
some  clients  as  department  management  and  program  staff  travel 
around  the  state.    It  is  important  for  program  staff  and  management 
to  personally  contact  clients.   However,  only  a  limited  amount  of 
reliance  can  be  placed  on  this  information  because  contacts  may  not 
be  comprehensive,  systematic,  or  objective.    In  addition,  data 
which  is  gathered  is  not  formally  tracked  or  compiled.   This 
includes  information  obtained  through  personnel  contacts  or  from 
the  quarterly  reports. 


What  Should  a  Monitor- 
ing System  Include? 


Since  the  Regional  Development  Program  is  service  oriented  it  is 
important  an  ongoing  monitoring  process  exist.   This  enables 
management  to  continually  measure  program  quality  and  outcomes 
and  ensures  program  accountability.   This  also  helps  provide  more 
valid  and  accurate  information  to  ensure  clients  receive  quality 
service  and  that  the  program  achieves  its  intended  results. 


We  reviewed  a  study  completed  by  the  Urban  Institute  which 
focused  on  procedures  for  monitoring  the  quality  and  outcomes  of 
programs  like  the  Regional  Development  Program.    It  suggests  a 
monitoring  system  include  client  surveys  to  obtain  information  to 
help  assess  the  program's  performance.    Although  surveys  are  not 
a  perfect  source,  they  are  one  of  the  few  ways  to  obtain  reasonably 
accurate  information  on  service  quality  and  the  results  of  the 
service  provided.   The  Urban  Institute  study  indicated  client 
surveys  are  the  most  efficient  way  to  evaluate  whether  services 
actually  contributed  to  outcomes  and  perceptions  of  the  quality  of 


This  study  pointed  out  that  a  successful  monitoring  system  has 
several  key  characteristics: 
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Focus  on  service  outcomes  and  quality.    If  clients  are  not 
satisfied  with  the  program  they  will  be  unlikely  to  use  it  again 
or  recommend  it  to  others. 

Focus  on  helping  management  improve  operations. 

Multiple  performance  indicators  should  be  utilized.   This 
includes  service  quality  indicators  (accuracy  of  program 
information,  timeliness,  etc),  intermediate  indicators  (number 
or  percentage  of  clients  who  started  a  business,  significantly 
changed  nature  of  business  or  market,  etc)  and  long-term 
indicators  (number  or  percentage  of  clients  who  expanded 
operations,  increased  sales,  increased  the  number  of  jobs,  etc). 

Determine  the  extent  a  program's  service  caused  the  outcome. 
This  is  important  since  more  than  one  program  may  have 
assisted  a  client. 

Breakout  information  by  client  characteristics  such  as  region 
or  county,  industry  group,  size  of  firm,  etc.   This  information 
allows  management  to  determine  the  extent  they  are  serving 
different  categories  of  clients. 

Information  should  be  compared  to  previous  years  to  give 
management  the  ability  to  compare  performance  over  time. 
This  provides  a  "big  picture"  of  what  the  program  is  actually 
achieving. 

It  is  necessary  to  survey  clients  who  have  utilized  the  program  in 
order  to  obtain  feedback  regarding  what  resulted  from  the  service 
they  received  and  their  opinions  regarding  the  quality  of  service. 
However,  it  is  important  to  obtain  feedback  not  only  from  those 
clients  the  program  successfully  assisted  but  also  those  the  program 
did  not  successfully  assist.   This  process  would  provide  the  best 
overall  picture  of  program  activities.   For  example,  by  surveying 
clients  who  the  program  did  not  successfully  assist  client  needs 
may  be  identified  that  are  not  being  met.   In  addition,  this  process 
could  also  identify  if  the  program  is  performing  activities  which  are 
not  utilizing  program  resources  in  the  most  efficient  manner  or  not 
providing  significant  benefits  to  clients.   This  information  would 
help  identify  where  modifications  of  program  activities  are  needed 
or  help  justify  additional  resources  or  a  reallocation  of  existing 
resources. 
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We  contacted  the  Department's  of  Commerce  for  seven  other  states 
to  determine  if  they  have  monitoring  systems  in  place  to  monitor 
the  performance  of  their  programs.    We  found  all  but  one  state 
have  a  formal  system  in  place.    The  one  state  which  currently  does 
not  have  a  system  in  place  is  in  the  process  of  establishing  one. 
The  other  states  we  contacted  indicated  these  systems  have  helped 
improve  the  quality  of  their  programs  and  have  made  them  more 
accountable. 


Department  management  said  they  are  in  the  process  of  designing  a 
new  client  database.   They  indicated  this  database  will  help 
improve  their  monitoring  system.    The  purpose  of  this  system  is  to 
provide  detailed  information  regarding  clients  and  the  type  of 
service  they  received.    However,  management  was  concerned  the 
Regional  Development  Program  lacks  the  resources  to  establish  an 
ongoing  monitoring  system.    According  to  the  Urban  Institute 
Study,  data  collection  and  management  procedures  for  a  monitoring 
system  should  be  designed  to  be  as  inexpensive  as  possible  and 
keep  demands  on  personnel  time  to  a  minimum.    If  monitoring 
procedures  are  cumbersome  the  system  will  not  achieve  its  objec- 
tive.  The  Urban  Institute  suggests  a  monitoring  system  be 
performed  by  clerical  staff  or  consider  contracting  out  the  process 
to  either  the  private  sector  or  to  a  university  unit. 

Creating  a  database  to  maintain  detailed  client  information  is  one 
step  in  establishing  a  monitoring  system.  However,  the  program 
also  needs  to  develop  the  ongoing  measures  to  monitor  and  assess 
program  service  quality  and  outcomes. 


Recommendation  #3 

We  recommend  the  Regional  Development  Program 
monitor  and  assess  service  quality  and  program  outcomes 
on  an  on-going  basis. 
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Improve  Public  Aware-  The  Regional  Development  Program  defines  its  clients  as  Montana 

ness  of  the  Program  businesses,  communities,  and  the  local  development  organizations 

involved  in  economic  development  activities.    We  contacted 
businesses,  community  leaders  (mayors,  county  commissioners, 
etc),  and  local  development  organizations  around  the  state  to  obtain 
their  opinions  regarding  program  operations.   We  discussed  various 
issues  including  whether  or  not  they  have  ever  used  the  program, 
the  types  of  assistance  they  received,  whether  they  were  satisfied 
with  the  assistance  received,  and  any  improvements  they  believed 
were  necessary  to  the  program. 

We  conducted  a  limited  survey  of  clients  to  obtain  their  opinions 
regarding  program  service.   Overall,  we  found  clients  who  have 
utilized  the  program  appreciated  the  efforts  of  program  staff. 
However,  not  all  of  the  clients  we  contacted  understood  the  role  of 
the  program.    For  example,  we  identified  local  development 
organizations  which  did  not  understand  what  the  function  of  the 
program  was  or  how  the  program  should  be  used.    Although  the 
main  aspect  of  the  program  is  to  seek  out  potential  economic 
development  opportunities,  the  program  also  relies  on  clients  to 
point  these  opportunities  out  to  them.   If  clients  do  not  understand 
the  role  of  the  program  then  potential  economic  development 
opportunities  may  go  undeveloped.   To  maximize  the  utilization  of 
the  program  it  is  important  clients  understand  the  program's  role. 
The  program  should  have  a  plan  of  action  to  improve  public 
awareness  of  the  program  and  its  mission. 

Department  management  agree  it  is  important  both  clients  and 
resources  understand  the  role  of  the  program  and  be  aware  of  what 
the  program  does.   They  indicated  because  there  are  only  five 
RDOs  responsible  for  large  geographic  regions  it  is  difficult  for 
them  to  inform  all  potential  clients  about  the  program.   They 
believe  it  could  take  years  to  make  all  potential  clients  aware  of  the 
program.   They  are  also  concerned  that  formally  advertising  the 
program  could  lead  to  client  expectations  the  program  could  not 
meet  with  existing  resources.   For  example,  department  manage- 
ment indicated  because  the  program  only  has  five  RDOs  they  could 
receive  more  requests  for  assistance  than  the  program  could 
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reasonably  manage.    Consequently,  they  are  concerned  that  this 
would  negatively  affect  the  service  the  program  currently  provides. 

We  understand  managements  concern  of  not  potentially  meeting 
clients  expectations.    However,  we  believe  the  mission  can  be 
communicated  to  clients  in  such  a  way  to  avoid  any  false 
expectations  about  what  the  program  can  accomplish.    Since  it  is  a 
public  program,  public  awareness  should  be  improved  so  all 
potential  clients  and  program  resources  have  an  opportunity  to 
utilize  the  programs  services.    A  plan  should  be  established  to 
ensure  all  clients  and  resources  understand  what  the  program  does. 


Recommendation  #4 

We  recommend  the  Regional  Development  Program 
develop  a  plan  to  improve  public  awareness  of  the 
program  and  its  mission. 
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MONTANA 
DEPARTMENT  OF  COMMERCE 


Director's  Office 

1424  9th  Avenue  PO  Box  200501 

Helena,  MT  59620-0501 


Phone  (-4061  444-3494 
FAX:  (406)444-2903 
TDD:   (406)444-2978 


June  6,  1995 


Legislative  Audit  Committee 
Office  of  the  Legislative  Auditor 
State  Capitol 
Helena,  MT    59620-1705 


Dear  Committee  Members: 

The  following  provides  my  response  to  the  performance  audit  of  the 
Regional  Development  Program  of  the  Economic  Development  Division. 
Before  responding  in  detail,  I  would  like  to  say  that  the  information 
provided  by  the  Legislative  Auditors  Office  will  result  in  even  better 
economic  development  results  within  the  state  as  a  result  of  the  efforts  of 
the  individuals  working  in  this  program. 


I  would  like  to  point  out  that  the  Regional  Development  Program  is  a  new 
and,  I  believe  ,  more  effective  way  of  achieving  positive  economic 
development  results  than  the  former  organization  of  the  Economic 
Development  Division.  Because  the  service  provided  by  this  program  is 
relatively  new  and  was  just  starting  at  the  time  that  the  field  work  for  the 
audit  was  conducted,  most  of  the  suggestions  made  during  the  interim 
have  been  implemented.  Some  amount  of  time  is  required  to  implement 
all  of  the  recommendations. 


Sincer 


Jon  Noel;  Director 
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